Classification of Imbalanced Offensive Dataset – Sentence Generation for Minority Class with LSTM

نویسندگان

چکیده

The classification of documents is one the problems studied since ancient times and still continues to be studied. With social media becoming a part daily life its misuse, importance text has started increase. This paper investigates effect data augmentation with sentence generation on performance in an imbalanced dataset. We propose LSTM based method, Term Frequency-Inverse Document Frequency (TF-IDF) Word2vec apply Logistic Regression (LR), Support Vector Machine (SVM), K Nearest Neighbour (KNN), Multilayer Perceptron (MLP), Extremly Randomized Trees (Extra tree), Random Forest, eXtreme Gradient Boosting (Xgboost), Adaptive (AdaBoost) Bagging. Our experiment results Offensive Language Identification Dataset (OLID) that machine learning significantly outperforms.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Class-Boundary Alignment for Imbalanced Dataset Learning

In this paper, we propose the class-boundaryalignment algorithm to augment SVMs to deal with imbalanced training-data problems posed by many emerging applications (e.g., image retrieval, video surveillance, and gene profiling). Through a simple example, we first show that SVMs can be ineffective in determining the class boundary when the training instances of the target class are heavily outnum...

متن کامل

Under-Sampling Approaches for Improving Prediction of the Minority Class in an Imbalanced Dataset

The most important factor of classification for improving classification accuracy is the training data. However, the data in real-world applications often are imbalanced class distribution, that is, most of the data are in majority class and little data are in minority class. In this case, if all the data are used to be the training data, the classifier tends to predict that most of the incomin...

متن کامل

Alleviating Classification Problem of Imbalanced Dataset

The Class Imbalance problem occurs when there are many more instances of some class than others. i.e. skewed class distribution. In cases like this, standard classifier tends to be overwhelmed by the majority class and ignores the minority class. It is one of the 10 challenging problems of data mining research and pattern recognition. This imbalanced dataset degrades the performance of the clas...

متن کامل

Imbalanced Dataset Classification and Solutions: a Review

-Imbalanced data set problem occurs in classification, where the number of instances of one class is much lower than the instances of the other classes. The main challenge in imbalance problem is that the small classes are often more useful, but standard classifiers tend to be weighed down by the huge classes and ignore the tiny ones. In machine learning the imbalanced datasets has become a cri...

متن کامل

Densely Connected Bidirectional LSTM with Applications to Sentence Classification

Deep neural networks have recently been shown to achieve highly competitive performance in many computer vision tasks due to their abilities of exploring in a much larger hypothesis space. However, since most deep architectures like stacked RNNs tend to suffer from the vanishing-gradient and overfitting problems, their effects are still understudied in many NLP tasks. Inspired by this, we propo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Sakarya university journal of computer and information sciences

سال: 2022

ISSN: ['2636-8129']

DOI: https://doi.org/10.35377/saucis...1070822